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Abstract. This paper studies conditions for invariance of dynamical systems on stratified do- 
mains as originally introduced by Bressan and Hong. We establish Hamiltonian conditions for 
both weak and strong invariance of trajectories on systems with non-Lipschitz data. This is done 
via the identification of a new multifunction, the essential velocity multifunction. Properties of 
this multifunction are investigated and used to establish the relevant invariance criteria. 
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1. Introduction 

This paper is concerned with characterizing strong and weak invariance of a dy- 
namical system with non-Lipschitz data in the form of a so-called stratified system; 
this form was introduced by Bressan and Hong pQ. Our dynamical system takes 
the form of a differential inclusion 

\x{t) G G(x(t)) a.e. t G [0,T] 
\x(0) = x. 

Stratified systems will be defined precisely in the next section, but to speak sum- 
marily, these are systems endowed with a layered structure of subdomains, each 
having their own dynamics that not only allow, but encourage movement in low 
dimensional submanifolds. One can envisage a stratified system as a collection of 
"highways" on which rapid and efficient movement can be exploited in relation to 
the surrounding "countryside" . This contrasts with previous studies by Soravia [T7] 
and Camilli and Siconolfi [2] who studied problems with much weaker assumptions 
but requiring relevant trajectories being unable to remain in a set of discontinuity 
for nontrivial time intervals. 

Our approach to characterizations of flow invariance will closely follow the de- 
velopment in |I9j . In fact, the main difference between that and the current devel- 
opment is in the characterization of Strong Invariance (SI) (a new characterization 
of weak invariance is also required since a new Hamiltonian is utilized). Recall that 
for dynamics G and a closed set C C R N , G is SI on C provided every trajectory 
x(-) of (DI) G with x £ C has x(t) G C for all t G [0,T]. With a Lipschitz hypothesis 
on the dynamics, an infinitesimal characterization of SI was first proved by Clarke 
[3] in tangential form, and later by Krastanov [TT] in normal form. See also [SJ [7] . 
The Lipschitz hypothesis was invoked in [19] precisely to exploit this characteriza- 
tion. The first result (to our knowledge) characterizing SI for non-Lipschitz systems 
is contained in [9], where the dynamics are one-sided (dissipative) Lipschitz. We 
prove a new characterization for SI in Theorem 14.1 1 below for discontinuous dynam- 
ics that satisfy an Euler arc property. Moreover, we obtain a growth estimate of 
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the distance back to C along a trajectory, a result that plays an important role later 
in the paper. 

It is not clear whether the dynamics that arise from a stratified system have the 
Euler arc property globally, and so Theorem 14.11 is not applied directly. However, 
each subsystem restricted to its subdomain satisfies the property, and this turns 
out to be sufficient to prove the characterization on the entire domain. A major 
complication that needs to be overcome is how to handle trajectories that cross 
manifolds infinitely often in finite time, exhibiting a type of "Zeno" effect that often 
plagues hybrid system theory; Example[5]in Section[7Jprcscnts a means to construct 
these types of complicated trajectories. Inherent in the stratified apparatus is a 
structural condition on the dynamics providing the environment from which such 
arcs can be approximated by more manageable ones. One of the key properties of 
stratified trajectories is that they cannot move immediately into another subdomain 
of the same or lower dimension, thus giving a particular form to how the Zeno effect 
can occur. The proofs of Lemma 15.51 and Theorem 16.11 contain details on how to 
construct approximate trajectories and deal with Zeno-type arcs. 

The stratified system in this paper has additional structure beyond what was 
originally proposed in pQ. Specifically, we require the closure of each subdomain 
to be proximally smooth and to be relatively wedged. Loosely speaking, proximal 
smoothness of the subdomains says there are no "inward" corners, which in turn 
implies the graph of the normal cone has a desirable closure property. The wedged 
assumption means that none of the "outward" corners are cusps, which is saying 
every normal cone on the boundary has a relative pointedness condition. Equiva- 
lently, this means the dimension of the relative interior of the tangent cone at each 
point throughout the boundary is the same as the dimension of the subdomain. 
The wedged assumption is relative in the sense that, in local coordinates, it is ac- 
tive in the same subspace as the embedded submanifold. The relative pointedness 
condition appears to be a new concept and is fully explained and developed in 
the appendix. These additional properties provide the framework to describe the 
relative boundary of the tangent cone, the understanding of which is crucial to iden- 
tifying the essential velocity multifunction G" . The values of G" are exactly those 
velocities that can be realized by trajectories of the system; see Proposition 15.11 
below. 

Having identified G" as the multifunction to characterize strong invariance, we 
must then assure that it is not too small to characterize weak invariance. This 
turns out to be more of an issue than perhaps it first appears, and is confronted in 
Section [6j 

The paper is organized as follows. We begin in Section [2] by describing the 
stratified formalism, and proceed in Section [3] to provide further background and 
explain the relevant terms. We relegate to the appendix the more complicated 
nonsmooth analysis involved in describing normal and tangent cones, and describe 
in detail there the "relative wedged" condition. Section [4] is devoted to proving 
a new characterization of strong invariance for possibly discontinuous dynamics. 
Strong invariance is characterized for stratified systems in Section [5j where the 
essential velocity multifunction G" is defined. The weak invariance characterization 
using is given in Section [5] Two examples are provided in Section [JJ the first 
providing a means to construct Zeno-type arcs, and the second constructing a type 
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of Zeno arc with a somewhat surprising property. Finally, Section |8] summarizes 
our approach and describes and suggests ongoing future research directions. 

2. Stratified systems 

We now describe a stratified dynamical system that was introduced by Bressan 
and Hong [I]. The closure of a set M is written as M. 

2.1. Stratified domains. We are given a finite collection of smooth (meaning at 
least C 2 ) manifolds {Mi, . ■ . , Mm} embedded in such that 

• R N = Ufi x Mi and Mi n Mj = when i ^ j; 

• If M 3 flM^fl, then X 3 C A?*; 

• Each Mi is proximally smooth of radius <5; 

• Each Mi is relatively wedged. 

The last two conditions were not included in [I], but will be required in our study. 
Their precise meaning and importance will be fully explained in Section [3] Such 
a collection is called a (proximally smooth and wedged) stratified domain, and 
its components Mi are called stratified subdomains. The dimension of Mi is 
designated by d t . 

Example 1. A very simple example is depicted in Figure[T]with N — 2 and M = 5. 
Here, the only two dimensional manifolds are the upper and lower open half spaces 
(Mi and M2), the only one dimensional ones are the positive and negative xi-axes 
(M3 and Ma), and the only zero dimensional manifold is the origin (M5). 



Mi ' 



■M3 • > 



M 2 



Figure 1 . A stratified domain 



2.2. Stratified dynamics. We next state dynamic hypotheses imposed on each of 
the subdomains. Let M C M. be an embedded manifold, and denote by Tm{%) the 
usual tangent space of M at x G M . Suppose r : M =4 is a multifunction. The 
following is a collection of Standard Hypotheses commonly imposed in differential 
inclusion theory: 



(SH) 



(i) V x 6 M, r(x) is a nonempty, convex, compact set 

satisfying T(x) C Tm( x )\ 
{11) The graph gr r := {(x, v) : v G T(a;)} is a closed set relative 

to M x R N ; 

(iii) 3 r > so that max{|t;| : v G T(a;)} < r(l + |a;|). 
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Associated with (M , F) is the differential inclusion 

(x(t)€T(x(t)) a.e. ie[0,T) 
[ ,F \x(0)=x, 

which, with x <E M and under the assumptions in (SH), has at least one solution 
x(-) defined on a nontrivial interval [0, T). Note the tangent space inclusion in 
(SH)(i) implies all solutions of (DI)r remain in M. If T = +00 or x(t) approaches 
M\M as t /• T, then T is called the escape time of x(-) from M and is denoted 
by Esc (x(-),.M,r). Every trajectory can be extended to an interval of maximal 
length, and thus if not otherwise stated, we assume all trajectories are defined on 
the maximal interval of existence. 

A further hypothesis often invoked in standard differential inclusion theory is a 
strengthening of (SH)(ii) by requiring a Lipschitz property on bounded subsets of 
M with respect to the Hausdorff metric. This means for each r > 0, there exists a 
constant k r > so that 

(iv) x,yeMDrM => dM n (T(x), T(y)) < k r \\x - y\\, 

where r B denotes the ball centered at the origin of radius r, and dist-^ is the usual 
Hausdorff distance between compact sets. Condition (iv) is equivalent to 

\h T {xX)~h T {y,C)\ < MICH \\x-v\\ Vx, yGA^nrB, CeK", 
where hr '■ x R N — > R is the (minimized) Hamiltonian associated with T given 

by 

hr(x,Q= inf (u,C). 
ver(x) 

A manifold and multifunction (M, T) for which (i)-(iv) hold is said to satisfy (SH) + . 
Notice that the Lipschitz condition holds throughout any bounded subset of M, and 
hence such a multifunction T can be extended to the closure M. while maintaining 
the Lipschitz property over M. We denote this extension by V. 

Now, a stratified domain {A^i, . . . ,Mm} is given, and associated to each man- 
ifold Mi is a given multifunction Fi : M.i M. N . Each (Aii,Fi) is assumed to 
satisfy (SH) + . Since there are only finitely many objects, we can choose the same 
constants in (i)-(iv) for all of them. Moreover, due to (iii), all of the analysis is 
essentially local (i.e. takes place in an a priori bounded set), and so for bookkeeping 
purposes we refer to only one Lipschitz constant k in (iv) and drop the subscript r. 

The basic velocity multifunction F : M™ 1" is defined by 

F(x) = Fi{x) whenever x G Mi. 

Observe that F does not necessarily satisfy (SH)(ii) on R N , and hence no general 
existence theory nor desirable closure properties of its trajectories are available. 
To circumvent the difficulties these theoretical shortcomings would entail, one may 
introduce the Filippov regularization G : M™ =4 K™ given by: 

G(x)= f]co\J{F(y): \\y - x\\ <s}. 

e>0 

It can be easily shown that G satisfies (SH), although now it is no longer the 
case that the Lipschitz condition (iv) will hold for (M. N ,G). By the nature of the 
stratification structure, one can easily derive the representation 

(2.1) G(x) = co {Fi(x):x€ Mi}. 
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Figure 2. Stratified dynamics 



Example 1. (continued) Suppose the following dynamic data, which is a simplifi- 
cation of the dynamics in Example 3 of [1] , is associated with the stratified domain 
in Example [T] (we abuse set notation here since only singleton values are involved): 



-1 



Fn 



Fa 







Note that F5 need not be explicitly stated since Tm 5 (0) = {0}, and consequently 
by (SC), F$ must consist of only the zero vector. This is the case for all zero 
dimensional manifolds. Obviously G differs from F only on the xi-axis, with 



G 



Xl 



where 



r {v: M + \v 2 \ < 1, vi > 0} ifsi<0 
{v: \vi\ + \v 2 \ < 1} if xi =0 

Jtf:M + N<l,ui<0} ifa;i>0, 



The arrows in Figure [2] depict the values of the basic velocities, 



and the shaded regions are the values of G at points on the x\ axis. 



The multifunction G is used as the dynamic data for the control problem. For 



x G 



(DI)c 



pN 



consider the differential inclusion: 



x(t) e G(x(t)) a.e. t G [0,T] 
x(0) = x. 



Again following pQ , we assume that the stratified dynamics satisfy the Structural 
Condition 



(SC) 



G(x) (~1 Tm,{x) — Fi(x) whenever x G Mi 



The condition (SC) plays a major role in this theory, and ensures that there does not 
exist a trajectory of G that is not already implicit in F. The following proposition 
makes this statement precise, and its proof is essentially contained in the argument 
at the bottom of page 319 in pQ. It is provided here for both completeness and 
clarity to assist in following the subsequent development. 



Proposition 2.1. Suppose x(-) : [0,T] 
are equivalent. 

(a) x(-) satisfies (DI)q; 



is a Lipschitz arc. Then the following 
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(DI) 



(b) x(-) satisfies 

(x(t) G F(x(t)) a.e. G [0,T] 
\x{0)=x; 



(c) For each i, x(-) satisfies x(0) = x and 

(DI)f ; x(t) G Fi(x(t)) a.e. whenever x(t) G Mi. 

Proof. It is clear that (b) and (c) are equivalent, and that these imply (a) since 
Fi{x) C G(x) whenever x G Mi. So assume (a) holds and we must show that (c) 
holds as well. 

For each i, let Jj := {t G [0,T] : x(t) G -Mj}, which is a Borel measurable set. 
Let 

Ji := {t E Ji : x(t) exists in G[x(t)) and t is a Lesbesgue point of Ji}. 

It is clear that Ji has full measure in J,. If t G Ji, then being a Lebesque point 
implies there exists a sequence {sj} so that — > t as j ' — > oo with < 7^ Sj G Jj for 
all j. In particular, x(sj) G Mi for all j, and therefore 

x(t)= lim ^'f e^^t)). 

j->oo Sj — t 

We conclude by (a) and the assumption (SC) that 

i(t) G G(a;(t)) nr^,(^)) = Fi(x(t)) Vt G J,-, 
which proves (c). □ 



3. More preliminaries 

We now review the background in nonsmooth analysis and differential inclusion 
theory required in our analysis. The relative pointedness concept appears to be 
new, and thus the main consequences of this condition necessitates elaboration and 
detailed proofs. These will be provided in the appendix. 

3.1. Background in nonsmooth analysis. Recall that a vector £ is a proximal 
normal to a closed set C C M. N at c G C provided there exists a > so that 

<C,c'- C )<^|| C '- C || 2 Vc'eC. 

In such a case with ||£|| = 1, we have Cn{c + <r[C + B]}= {c} and say that £ is 
realized by a. The set of all proximal normals is a convex cone and is denoted by 
Nq(c). If 9 : M. N — > (— 00, +00] is lower semicontinuous (lsc) and x G dom 9 := 
{x G R w : 9(x) < 00}, then the proximal subgradient dp9(x) is defined as those 
Cel" satisfying (C, -1) G Af^ pi g (x,9(x)), where epi 9 := {(x,r) : r > 9(x)} is 
the epigraph of #(•). 

A key assumption of a stratification is proximal smoothness. Proximal smooth- 
ness was a term introduced in [4] but whose concept was broached much earlier. 
Federer |10j apparently first introduced the idea under the name of "sets with posi- 
tive reach," and it has been subsequently and independently rediscovered by many 
authors since then. 
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A closed set C C M. N is called proximally smooth of radius <S > provided the 
distance function 

dc(x) := inf ||c-x|| 

is differentiable on the open neighborhood C + {5 + e}M of C for some e > 0. 
The e is added to this definition to avoid small technical anomalies. There are 
many equivalent statements to this property, and we content ourselves here with 
mentioning only one: C is proximally smooth if and only if Mq '(c) ^ {0} for all 
c G bdry C, and all unit normals can be realized by the same constant a := S. In 
this case, the proximal normal cone coincides with the Clarke normal cone A/"c(c), 
and so in discussing normal cones to proximally smooth sets, we can shorten the 
notation of the proximal normal cone to Ac(c) and observe that c|=t A/"c(c) has 
closed graph. 

With C proximally smooth, there is no need to stipulate which tangent cone is 
in use either, since the Bouligand and Clarke tangent cones coincide. Recall the 
Bouligand tangent cone 7c (c) at c G C is defined as 

(3.1) Tc(c) = {,:hm inf dc(c + fa) =0} 

and in the case of C proximally smooth (and so is the Clarke cone as well) , equals 
the negative polar of Nc (c) : 

veTc(c) <=> ((,v)<0 VCGAA c (c). 

If M. is an embedded C 2 manifold, C :— M, and c € A4, then 7c (c) agrees 
with the usual tangent space Tm{c) to M at c from differential geometry (see [7j 
Proposition 1.9]). If in addition M is proximally smooth, then for each x G M, the 
tangent cone Tj^(x) is closed and convex, and thus has a relative interior denoted 
by r-int Tj^(x) (see [H]). Its relative boundary is defined as r-bdry 7j^(x) := 
Tjj(x)\r-int T-j^x). 

Another key assumption on the stratified data is each domain being relatively 
wedged. A set C C R N is wedged (see [71 p. 166]) if for every x G bdry C, the (Clarke) 
normal cone is pointed. If C = M is the closure of an embedded manifold Ai, 
then C is relatively wedged means each such normal cone is relatively pointed. The 
concepts of pointedness and relative pointedness are fully explained in the appendix. 
In short, within the context of a given stratification, the new concept of M-j^.{x) 
being relatively pointed is equivalent to saying the dimension of r-int Tj^. {x) is dj. 
Its key contribution to our analysis is exposed in the next lemma, which is proven 
in the appendix. 

Lemma 3.1. If x G Aii\M.i and v G r-bdry 7x7 (x), then there exists an index j 
for which A4j C Aii, x G M.j, and v G Tm {x). Of course in this case, one has 
dj < di. 

3.2. Background in differential inclusion theory. References for this section 
are [3E|. 

Dynamic optimization relies heavily on the compactness of trajectory theorem 
(0 Theorem 3.1.7], [TJ Theorem 4.1.11]). This important theorem essentially asserts 
(with state space A4 = R N ) that a sequence of arcs that are almost trajectories of 
a differential inclusion with data satisfying (SH) has a subsequence that converges 
uniformly to an actual trajectory. 
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Suppose r : R N =} R N satisfies (SH). The concept of an Euler solution to (DI) r 
was introduced in 7 , and can be described as follows. Let n be a partition of 
[0, T], say n = {0 = to < t\ ■ ■ ■ < tg, = T}. Usually one takes t n = n-j, but this 
is not necessary. The norm of the partition is ||7r|| := max {t n — £ n _i}. Let 

n— !,...,£ 

7(-) : M. N — > M. N be any function that is a selection of L; i.e. j(x) £ for all 
x. Given the initial condition xq = x in (DI)p, define a sequence of node points 
recursively by 

x\ = x + (ti - to)7(x ) 
x 2 = x\ + (t 2 - h)j(xi) 



Xi = Xt-i + fa-tt-iWlt-i). 

The Euler polygonal arc x 7T (-) is the piecewise linear function defined on [0, T] that 
linearly interpolates the above sequence. That is, 

x w (t) = x„ + (t - t n )~f(x n ) whenever t £ [t n ,t n+1 \. 

The compactness of trajectories theorem implies that for a given selection 7(-), a 
sequence {^ Tr " l (-)} of Euler polygonal arcs converges uniformly to a solution x(-) of 
(DI)r as ||7r m || — y as ttl — y oo. Such an x(-) is called an Euler arc. 

Suppose M is an embedded manifold with Ai proximally smooth of radius S. 
We define the extension T cxt : { M + <5B} =$ R N of T by setting 

(3.2) r oxt (x) =T (proj^(x)) 

whenever icM + SM. As (essentially) noted in [4] Remark 4.9], if (A4,T) satisfies 
(SH) (respectively (SH) + ), then (M + <5B,r cxt ) also satisfies (SH) (respectively, 
(SH)+) The Lipschitz constant for r ext in (iv) could perhaps be larger, but for 
notational simplicity we still denote it by k. 

The Euler arc concept can be naturally extended to multifunctions defined on 
manifolds in one of (at least) three ways. These include (1) utilizing a change of 
variables with a fixed atlas of local charts, (2) applying the known concept to the 
extension r ext as defined in (|3.2[) . or (3) taking a projection back to the manifold 
at each discrete time step. These methods will be compared elsewhere, but here we 
opt for the latter. Recall 7(-) is a selection of V on A4. The node points are now 
chosen as 

x n+ i = proj^j- x n + {t n+ i - t n )j(x n ) 

and the process terminates when x n+ i G A4\A4. The Euler polygonal arc a; 7r (-) is 
defined as before. Although x 7T (-) may leave M, since dj^[x^ + (t n+ i — t n )'y^x n )] < 
c\\ir\\ for some constant c independent of 7r or n, the limiting Euler arc will lie in 
M and be a trajectory of (DI)r- 

Suppose M is an embedded manifold and (Ai,T) satisfies (SH). Consider the 
property 

(v) Every solution x(-) of (DI)r is an Euler arc. 
Specifically, (v) means that if x(t) £ r(x(£)) a.e. t £ [0, T] with x(0) = x, then there 
there exists a selection 7(-) of T and a sequence of partitions {7r m } with [|7r m [| — > 
so that the Euler polygonal arcs x^ m associated with j(-) converge uniformly to 
x(-). We call (v) the Euler arc property, and note that the Lipschitz assumption 



FLOW INVARIANCE ON STRATIFIED DOMAINS 



9 



(iv) implies (v): This was shown for M = M. N in [7j Theorem 4.3.7]. In fact, a 
selection 'y(-) can be produced for which the Euler arc is unique (i.e. is independent 
of the sequence of partitions) . The proof of the extension of this result to manifolds 
is routine. We shall use the Euler arc assumption (v) in Theorem 14.11 below when 
we give a new result on strong invariance. 

We need another important result from ~R N to be adapted to manifolds, and this 
is known as the Filippov approximate trajectory theorem (see Theorem 3.1.6]). 
With r defined on and satisfying (SH) + , this theorem says the following: Sup- 
pose y(-) is a Lipschitz arc defined on [0,T]. Define 

(3.3) P[o,T](y(0) =J dist(y(t),T(y(t))^dt, 

where for purely aesthetic purposes we switch to the notation dist(u, C) := dciy). 
The theorem concludes that there exists a trajectory z(-) to (DI)p with z(0) = y(0) 
and for which 

\\y(-)-z(-)\\<e kT p [0 . T] (y(-)). 

The result is valid even without T having convex values; however, assuming it does, 
then an additional property can be asserted. Namely, if y(-) is C 1 , then the solution 
z(-) can be chosen C 1 also. This is not often explicitly stated, but follows from the 
construction of z(-) in the proof of [5, Theorem 3.1.6]. We adapt this result to 
manifolds in the next proposition. 

Proposition 3.2. Suppose A4 is an embedded manifold with M. proximally smooth 
of radius S, and (M, T) satisfies (SH)+. Suppose y(-) : [a, b] — > A4+6M is a Lipschitz 
arc with y(a) <E Ai, and for a < t < b, define 

P[a,t](y(-)) = J dist^y(s),r(proj M (y(s)))^ ds. 

Then there exists a trajectory z(-) of T with z(0) = y(0) that is defined on the 
interval [a,t), where t := min {b,Esc (z[-),M,T)}, so that 

sup \\y(s) - z(s)\\ <e k ^ p [aA (y(-)). 

s£[a,t] 

for all t £ [a, t). If y(-) is C , then z(-) can be chosen C 1 as well. 

Proof. Consider r cxt defined in (|3.2p . The usual result [SJ Theorem 3.1.6]) now 
applies and yields the desired estimate. The fact that z(-) actually remains in A4 is 
due to z(0) = y(0) e M and that (A^,r cxt ) is strongly invariant (see (14.1[) below, 
or [SHE]). □ 

Remark 3.1. If it is the case that 

inf \\y(t)-z\\ >e k ^ P[a . t] (y(-)), 

z£M\M ' ' 



for all t G [a, 6], then t = b in Proposition 13.21 

The following result is not usually emphasized in differential inclusion theory, 
and so we include it here along with a short proof. 

Proposition 3.3. Suppose (Ai,T) satisfies (SH) + andv G r(x). Then there exists 
a C 1 trajectory x(-) of (DI)r for which x(0) = v. 
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Proof. We can assume M=R N . Define y(t) = x + tv for t G [0, T], which is a C 
arc that satisfies 

P[o,t] = y dist(u, r(s + «;)) < ^t 2 . 

By Proposition [XU there exists a C 1 arc x(-) defined on [0, T] satisfying 

1 



(3.4) 
We have 



||tf(i)-a:(t)|| < sup ll^s)-^)!! < 2 fc || v |] e kt t 2 . 
se[o,t] * 



k> — i(0) = lim 
1 11 t\o 



y(t) — x x(t) — x 



lim 



y(t) - x{t) 



by (pO]) , Therefore ±(0) = v. 



□ 



4. Sufficient condition for strong invariance 



JV 



Suppose M. C R is an embedded manifold, a multifunction L : .M = 
satisfies (SH), and C C M. N is closed. Then (A^,T) is said to be strongly invariant 
on C provided every solution x(-) of (DI)r with x £ M. PI C is such a;(t) 6 C for all 
t £ [0, Esc (x(-), A4, rj) . It is convenient in this section to notate the (maximized) 



Hamiltonian Hr : 



piV 



pA 



by 



#r(^C) = -Mz,-C) 



max (7, C)- 

7 er(x) x 



The following theorem is a sufficient condition that generalizes one half of a well- 
known characterization of strong invariance in the case when A4 = M. N and T 
satisfies (SH) + . The characterization with Lipschitz data is the HJ inequality 



(4.1) 



H r (x,C)<0 Vx G C, C G N£(x), 



and its equivalence was first proved in a tangential form by Clarke [3] (see also 
O [7]) and later in the normal form (|4.1[) by Krastanov [TT]. Although Clarke's 
original proof in [3] has the same flavor as ours, it nevertheless relied heavily on 
the Lipschitz property. 

Our result has interest beyond stratified systems, and gives a sufficient con- 
dition for strong invariance for any potentially non-Lipschitz system whose only 
trajectories are Euler arcs. This result should be compared with the main result 
in [9], where the structure of a dissipative-Lipschitz multifunction was exploited 
to provide the first (to our knowledge) characterization for strong invariance with 
non-Lipschitz dynamics. There is a nontrivial intersection between these results, 
but also a substantial difference in that [9] assumes a structural statement directly 
on the dynamic data, whereas the stratification system relies on state-dependent 
assumptions. 

For a closed set C C R , denote by 

C(x) = proj c (x) := {c G C : ||x - c|| = d c (x)} 

the set of closest elements in C to x. We also will later use the notation proj(x,C) 
for proj c (x). 
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Theorem 4.1. Suppose M. C M. N is a bounded embedded manifold and T : M =4 
R N is a multifunction satisfying (SH) and the Euler arc assumption (v). Suppose 
C CR N is closed, and assume there exists a constant k > so that 

(4.2) x G M, c G C(x) =>■ H r (x,x - c) < nd 2 c (x). 
Then for i£M and x(-) any trajectory of (DI)r, we have 

(4.3) d c {x{tj) < e Kt d c (x) Vt G [0,T). 
In particular, (A4,T) is strongly invariant on C. 

Proof. Let x G M, < t < T, tt = {0 = t < t±, ■ ■ ■ < t{ — t} a partition of [0, t], 
and x~" (•) a polygonal Euler arc associated with tt. Thus a; 7r (-) is piecewise linear 
on [0, t], and for each n = 0, 1, . . . ,£ — 1 satisfies 



(in+l —tn)ln 



for some y„ G r(a£), where < := x n (t n ). Let ||L|| := sup{||-y|| : 7 G r(x), x G 
rBnAi} (with r sufficiently large), and choose any c„ G C(xJJ). For each n, we 
have 

< ll< + i-c„|| 2 

= ||<- C„f + 2(t n+1 - t n )( ln ,xl - Cn) + (t n+1 - t„) 2 ||7nf 

(4.4) < (1 + 2 (t n+1 -t n )n)d 2 c (xl) + \\ir\\ 2 \\T\\ 2 

j2 (x) 



< JJ(l + 2(tn/+l-*n')«)^ 
n'=0 

A-(l + 2||7r||« xn+ ' 



2k 



Ml lirf, 



where (|4.4I) holds by invoking the assumption (I4.2p . Now if x(-) is any solution to 
(DI)r, then by the Euler arc assumption (v), there exists a sequence of partitions 7r m 
and associated Euler arcs x m {-) := x nm (-) so that ||7r m || — >■ and ||x m (-) — x(-)|| — >• 
as 77i — y oo. Each a; m (-) satisfies the previous estimate, and hence ()4.3|) holds by 
letting 777 — > oo and taking square roots. □ 

Corollary 4.2. Consider a stratified system as introduced above. Suppose C C 

is closed and assume that gJ|) ZioZds /or .M = and F = G. For a /bed %, if 

x(-) : [a, 6] — > A'fi is a trajectory of G with x(t) G .Mi /or a/Z £ G (a, 6), i/ien 

dc(s(&)) <e k{b - a U c (x{a)). 

Proof. For all small e > 0, the arc x(-) restricted to [a + e, 6 — e] is contained in A4i 
and therefore is a trajectory of i^(-). Since (Mi, -?*(•)) satisfies (SH)+ it must also 
satisfy the Euler arc assumption (v). Since G = Fi when x G .Mi, we have that 
(|4~2"|) holds for (X,L) = (.M^T;). It follows from Theorem O that 



d c (x{a + e)) < e k{b - a - 2e) d c (x{b-e)). 
Letting e ! finishes the proof. □ 
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5. Strong invariance in stratified systems 

By attempting to characterize a value function as a solution to an HJ equation, 
it is not enough to merely have a sufficient condition for strong invariance as in 
Theorem \4A\ but rather one needs a full characterization. This is closely related to 
the two objectives stated in the introduction, where the necessity relates to (Objf) 
and sufficiency to (Obj2). Theorem 14. f I contains only a sufficient condition, and 
so we must seek a necessary one for stratified systems. This is the point that the 
stratification assumptions play their greatest role. Recall we are given a stratified 
domain {.Mi, . . . ,A4m} along with stratified dynamics encapsulated in G. 

Definition 5.1. The essential velocity multifunction G* : K. =4 R N is defined by 

(5.1) G i {x)=\J{F t {x)r\T^{x) -.xeM}- 

i 

The definition of G" should be compared with the representation (|2.1I) of G. One 
has G" lying "between" F and G; that is, for each x, we have 

(5.2) Fi(x) C G\x) C G(x) whenever x £ Mi. 

In general, G* will not possess the desirable properties typically invoked in differ- 
ential inclusion theory. For example, although its values are compact, they are not 
necessarily convex (violating (SH)(i)); nor is its graph necessarily closed (violating 
(SH)(ii)). Its designation as the essential velocity set is based on the following, and 
should be compared with Proposition 13.31 which assumed Lipschitz dynamics. 

Proposition 5.1. Suppose x(-) is a solution to (DI)q defined on [0,T). Then 
x(t) £ GHx(t)) for almost allt £ [0,T). Conversely, if v £ G*(x), then there exists 
T > and a C 1 solution x(-) to (DI)g with i(0) = v. 

Proof. The first statement of the theorem follows immediately from (|5.2[) and 
Proposition 12.11 As for the second statement, we separate the most important 
fact into the following lemma. A somewhat more general version of this lemma 
appeared in [5]; we offer a much simpler proof here by exploiting the stratified 
structure. 

Lemma 5.2. Suppose Ai is an embedded manifold with A4 proximally smooth of 
radius 5, the multifunction T : M. =4 satisfies (SH) + , and x £ M with Afrp((x) 
relatively pointed. Then for any v £ r(x) PI r-int Tj^(x), there exist T > and a 
G 1 trajectory x{-) : [0, T] — > M. U {x} so that x(Q) = x and x(0) = V. 

Proof. By considering local coordinates, we may assume without loss of generality 
that the dimension of A4 is N. Recall from (I3.2j) the extension r ext of T, which 
satisfies (SH)+ on M + 5M and agrees with T on M. By Proposition 13.31 there 
exists T > and a G 1 trajectory x(-) of r oxt with x(0) — x and i(0) = v. We will 
show x(t) £ M. for all small t which would finish the proof of the lemma. 
Since v £ int Tj^(x), by (|A.6[) there exists /i > so that 



M<-HKII vc£A%r(x). 
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Reduce T if necessary so that whenever < s < T, we have \\x(s) — v\\ < Then 
for all t £ (0, T] and all ( G J\fj^(x), we have 

,C) - 7 / (*(*), 0<k 



t / t . .. 

(5.3) = (v,C} + ± [ (x(s)-v,0ds 

1 Jo 

< -HICII + fllCII = -fllCII 

Suppose there exists a sequence t n \ with x(t„) ^ A4. Let x n — proj^-(x(i n )) 
and 

[C« ifx(i n )eAl 

where is any unit vector in A/^-(x(i n )J. Without loss of generality, we can 
assume ( n — > ( G Nj^(x). We have 

x(t n ) — x \ I x(t n ) — x . . \ / x(t n ) — x„ _ \ lx n — x. 

* — 'W = ( + — ^~^) + ( * — + — ' c " 

(5.4) > -HCn-Cll I'^-^ +O- 



Cn 



in 2(5 tn 

The justifications for the three lower bounds in (|5.4p are, respectively, the Cauchy- 
Schwarz inequality, the nature of ( n , and the facts that x G Af and S Nj^{x n ) 
is realized by (5. Observe the obvious estimate 

(5.5) \\x{t)-x\\ < f \\x(s)\\ds< \\T\\t, 

Jo 

where ||r|| is an upper bound on the values of T that can occur here, and 

(5.6) ||x„ - x\\ < \\x(t n ) - x n \\ + \\x(t n ) -x\\<2 \\x(t n ) -x\\<2 \\T\\ t n , 

where the second inequality follows since x n = proj^-(a;(t n )) and x G M, and the 
last one from (|5.5|) . Letting n — > oo in (|5.4[) and using the estimates obtained in 
(|5.5[) and (|5.6I) leads to a contradiction of (15.31) . The conclusion is x(t) € M for all 
small £ as claimed. □ 

Now we return to the proof of Proposition 15.11 Let v G G" (x) , and let i be 
such that x G Al* and u G Fi(x) n 7^f. (a;). If f G r-mi 7^f.(x), then the result 
follows by Lemma 15.21 If w ^ r-mf 7xf. (x), then u G r-bdry Tt^. (x) and hence by 
Lemma EUl there exists another subdomain Mj C A4j with x G Af,-, i> G Tj^ \x), 
and dj < d^. We also claim that 

(5.7) veF 3 {x). 

Indeed, since x G Mj, there exists a sequence x„ — >• x with x„ G Af-, C A4,-. 
Let u n = proj(y, .Fj-(x n )). Clearly u„ — »■ v since Fj(-) is Lipschitz on Mj, and 
therefore u G Fj (x) as claimed in (|5.T[) . We now have v G (x) fl (x) and the 
argument just given can be repeated with z replaced by j. This can be repeated 
as necessary but must terminate since the dimension is decreasing at each step. 
A stage is reached when v lies in the relative interior of the tangent cone of the 
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subdomain, at which point Lemma 15.21 can once again be invoked to complete the 
proof. □ 

Corollary 5.3. Suppose C C M. N is closed and (M. N , G) is strongly invariant on C. 
Then 

(5.8) h G ,(x,-C)>0 Vx e c, c e N£{x). 

Proof. Let x <eC and Q € JVq(x) be such that ||C|| = 1 and C be realized by a > 0. 
Fix v G G^(x). By Proposition 15.11 there exists a C 1 solution to (DI)g defined 
on an interval [0, T\. By the strong invariance property, we have x(t) G C for all 
t G [0, T], and therefore 

(t>,0 = lim ( X ^~ X X) <lim J-\\ x (t) - x\\ 2 = 0, 

where the inequality follows from £ G Mq(x) and x(t) G C, and the last equality 
from (|5.5j) . Taking the sup over u G G"(a;) yields (|5.8|) . □ 

We now turn to the sufficiency of (|5.8|) for strong invariance. The proof of this 
result is adapted from the clever and difficult argument used in the proof of [TJ 
Theorem 3]. 

Theorem 5.4. Suppose C is closed and i5.8\) holds. Then 

(5.9) d c (x(T)) <e kT d c (x(0)). 

for any x(-) that is a solution of (DI)q. In particular, (R w , G) is strongly invariant 
on C. 

Proof. Let C C R N be closed and x(-) a solution of (DI) G . Recall Corollary l4~2l 
where the estimate (|5.9[) was shown to hold provided x(-) restricted to the open 
interval (0, T) was a trajectory that resided in only one subdomain. The following 
lemma contains the key fact and its proof is perhaps the hardest analysis in the 
entire paper. 

Lemma 5.5. Suppose Mi is a subdomain and M. is a union of subdomains with 
M-i C J\A. Assume M. has the property that every trajectory x(-) of (DI)q defined 
on [a, b] with x(t) G M. for all t G [a, b] satisfies 

(5.10) d c (x(b)) <e k ^ a U c {x{a)). 

Then for any trajectory x(-) of (DI)q that lies totally within A4i UA4, we have that 
( fOj) holds. 

Remark 5.1. As in the proof of Corollary 14.21 the inequality (|5.10[) remains valid 
if x(a) and/or x(b) are not in M. provided x(t) G M. for t G (a, b). 

Remark 5.2. The assumption (|5.10[) seems to almost equal the conclusion (|5.9[) . 
Indeed, if x(-) is a trajectory so that [a, b] can be partitioned in a manner a = t$ < 
t\ < ■ ■ ■ < tf, = b in which x(-) restricted to (t n ,t n+ i) belongs to either M. or Mi, 
then the conclusion follows immediately by applying either (|5.10[) or Corollary 14.21 
on each subinterval and concatenating the estimates. In general, however, not all 
trajectories are like this, and one can even move in and out of Mi infinitely often 
(the so-called Zeno effect), or can reside in Mi for nontrivial time periods that are 
nowhere dense (see Example [2]). When this happens, there is no obvious procedure 
in how to paste the individual departures from Mi into one common estimate. The 
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following proof nonetheless finds a way around that by building "impulsive arcs" 
that uniformly approximate the original one and are well-behaved on the intervals 
of a partition. 

Proof. For notational convenience, assume x(0) £ A4i and x(T) £ Aii (by (|5.10| . 
there is no loss in generality in doing so). Let J := {t £ [0,T] : x(t) £ Ai}, which 
is an open set (since Aii C Ai) and so can be written 

oo 

J = {J {a n ,b n ) 

n=l 

where the intervals are pairwise disjoint. The proof is much easier if the sum is 
finite (see Remark l5.2p . For fixed £, write 

l 

h = [J (a n , K), 

n=l 

which after reindexing can be assumed to satisfy 

bo := < a\ < b\ < <i2 < 62 < ■ • • < a,i < bp < T —: ae + \. 

We note that for each n = 1, ••■ , £ + 1, both x(a n ) and x(6„_i) belong to Aii- Let 

r := inf \\x(t) - y\\ > 
te[p,T] 

yGMi\Mi 

(this is strictly positive because the range of x(-) is compact and is disjoint from 
Mi\Mi), and choose i sufficiently large so that 

T 

(5.11) meas(J\Jt) < 



2e kT \\G\y 

where meas(I) denotes the Lebesgue measure of / and ||G|| is an upper bound of 
all the relevant velocities that can appear. 

Note that x(a n ) and x(b n -i) belong to Mi for all n — 1, ... ,1 + 1, and x(t) £ M. 
for all t £ (a ni b n ). By assumption (j5.10[) and Remark |5. 11 we have 

(5.12) d c (x(b n )) <e k( - b ^ a ^d c (x(a n )) Vn = l,...,£ 

We will build arcs using Proposition 13 . 21 on the remaining intervals [6„,a n _|-i] that 
reside entirely within Aii- For n — 0,...,£, set e n :— meas((b n ,a n+ i) n J). Let 
y n {-) be the arc x(-) that is restricted to the interval [6„,a n+ i]. We calculate the 
closeness of y n {-) to a trajectory of (Mi,Fi) by 

Pn ■= P[b n ,a n+1 ](yn(-)) = dist (x(s), Fj (v n (s))j ds < 2 ||G|| £„, 

where the final inequality is justified via Proposition 12.11 (recall y n (t) = x(t) on 
[6„,a„+i] and Proposition 12.11 says x(t) £ Fi(x(i)} almost everywhere on the set 
where x(t) £ Mi.) By Proposition 13.21 there exists a trajectory z n (-) of (DI)f\ 
defined on [6„,a„+i] with z n (b n ) = y n (b n ) = x{b n ) and satisfying 

(5.13) \\y n (a n +i) - z n (a n+1 )\\ < e fc (-"+i- fc ") Pn < 2 ||G|| e k ^- b ^ e n . 
In the notation of Proposition 13.21 we have t = a n+ \ because 

P[6„,t](yn(0) <2\\G\\e<2\\G\\mea S (J\J e ) <re- kT 
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by (|5.11|) : see Remark [3.11 Since £„(•) is a trajectory of F, remaining in Mi, it 
satisfies the conditions of Corollary 14.21 and so 



(5.14) d c (z n (a n+1 )) <e k ^^d c (zn(b n )). 
The last ingredient needed is the trivial fact 

(5.15) d c (x(a n )) = d c (y n _ 1 (a n )) < d c (z n - 1 (a n )) + ||y n _ 1 (a„) - z„_i(a„)| 

We now calculate 

dc{x{T)) = d c (yi{a l+1 )) 

< dc(zi(a i+1 )) + \\yi(a i+ i) - z t {a t+ i)\\ (by (|5.15p ) 



(5.16) 



< e k(T-b e ) 



,k(T-b e ) 



< k(T-a e ) 



d c (zi(b l ))+2\\G\\E t 

d c (x(b e ))+2\\G\\e e 

d c {x{a t ))+2\\G\\s e 



(by fiTTfy and (|5TT5|) 



where (|5 . 1 0[) follows from (|5.12p . Repeating the previous argument on the interval 
[a£-i,ai\ gives the similar inequality 



d c (x(a e )) < c *(««-«w-0 



dc{x{ai-i)) + 2 



which after inserting into (|5.16p produces 



dc(x(T)) < (*W-*t-i) 
After I steps, the result is 



dc(x(at-ij) +2\\G\\ (et-x+ei) 



(5.17) 



d c (x(T)) < 



dc(x) +2\\G\\ J2 £ r, 



Finally, since Xm=i £ ™ = meas(j\Jg), the claim (|5.9|) follows from (I5.17[) since 
meas(j\Je) — > as ^ — !> oo. □ 



We shall use Lemma 15.51 to finish the proof of Theorem 15.41 We are given a 
trajectory x(-) of (DI)g defined on [0,T], and must show (|5 .9[) holds. Let i be 
the unique index with x(0) = x G .Mi. The proof is now based on an induction 
argument with regard to the dimension d\ of Mi. Assume first di — N . Let 
f = min{T, Esc (x(-), Mi, G)} > 0, and recall this means x(t) E Mi for < t < T 
and either T = T or x(T) e bdry A4 4 . The estimate (|5.9p holds with T replaced 
by T by Corollary 14.21 As an induction hypothesis, assume that for a dimension 
d < N, if > d, then there exists T > so that (|5.9[) holds with T replaced 
by any t G [0,T]. We have just shown this property holds for d = N. In order 
to show it holds for d — 1, assume di = d — 1 and let yVf consist of the union of 
all the subdomains Mj with Mi PI A^j ^ 0. The stratification assumptions imply 
Mi C A^j for each j in this union, and thus rfj > di + 1 > d for all such j. 
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We claim that M satisfies assumption (|5.10|) in Lemma [531 To see this, suppose 
y(-) : [a, b] — > M is a trajectory of (DI)g- Let 

b:=sup{te[a,b]:dc(y(t)) < e k ^de{y{a)) j 

Since y(a) lies in a subdomain of dimension greater than or equal to d, the induction 
hypothesis says that a < b. If b < b, then y(b) £ M and the induction hypothesis 
implies there exists T > so that every < t < T satisfies 

de(y(b + t)) < e k ^d c (y(b)) < e k ^ b+i - a U c (y(a)). 

This contradicts that b was a supremum, and thus M satisfies (|5.10[) as claimed. 

Recall x(0) G Mi and di = d — 1. Now x(t) belongs to Mi U M for all small 
t > 0, say for < t < T. This is because x(-) is continuous and x(0) is a positive 
distance away from Mi\Mi and every other subdomain that has dimension less 
than or equal to d — 1. Hence Lemma I5T51 can be applied on the interval [0, T], and 
the induction step is complete. 

To finish the proof, we proceed in the same manner that we used above to verify 
that M satisfied (|5.10j) . Indeed, let 

T-.= S uJt£[0,T]:d c (x(t)) <e k ^d c {x(0))\. 

One can show T equals T in precisely the same way that b = b was shown above. 
The proof is now complete. □ 



6. Weak invariance in stratified systems 

Recall that a system (M,T) satisfying (SH) is weakly invariant on a closed set 
C in an open set U C R N provided for all x e C n M (~l U, there exists a trajectory 
x{-) of (DI) r on [0,T) (with T = Esc (x(-),M n U, V)) so that x(t) e CC\U for all 
t £ [0, T). It is known (cf. [7]) that for = R N , this property is characterized by 

(6.1) hr(x,Q<0 VseCnW^eA/^ts). 

By introducing Cr as a certain submultifunction of G, we were able to characterize 
strong invariance through a Hamilton- Jacobi inequality using h G t as the Hamilton- 
ian. Although (Objl)^ and (Obj2)^ are thereby achieved (see Lemmas ?? and ?? 
below), the first objective (Objl) u can be maintained only if it is shown that the 
manner of reducing G was not so stringent that it lost the ability to characterize 
weak invariance. The following theorem provides the verification that it was not. 

Theorem 6.1. Suppose a closed set C C R N , an open setlA C R^, and a stratified 
system are given. Then (R , G) is weakly invariant on C in U if and only if 

(6.2) h G ${x,Q<0 Vx G CnU, C G Mc(x). 

Proof. Since (P is contained in G, we have Kq < h G t. Thus if (|6.2j) is satisfied, 
then so is (|6.1|) with T = G. We can then conclude (M. N , G) is weakly invariant on 
C in U. 

Conversely, suppose (M. N , G) is weakly invariant on C in U 1 and let x G CflW and 
C £ Mq{x) be given. By weak invariance, there exists a solution x(-) to (DI)g that 
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lies in C C\U for all t G [0,T). Let t n \ so that x n '■= x(t n ) satisfies — f 
for some v. We obviously have 



(6.3) 



(v, C) = lim 



tr. 



2(7 f„ 



as n — > oo. The convergence to is a consequence of the same inequality that was 
recorded in (15.51). We claim that 



(6.4) 



v e co G*(a;), 



where co G*(x) denotes the set operation of taking the convex hull of G"(x). Along 
with (|6.3p . this will imply (j6.2[) since one has 

h Gi (x,C)= ,inf >',C> = , inf f (v',0- 

We seek to verify (|6.4| . Let J™ := {i G [0,t n ] : x(t) G A4J, and write i(x) 
for those indices for which fxf := meas^J™) > for all n. Then i G i(x) implies 
x G A4i. Without loss of generality, we may assume for each i G i(x) there exists 
< Xi < 1 and Vi G R N so that 



(6.5) 



T 2- ^ A " ^ = 1, and — / x{t) 



«i G Fi(x) 



as n — > oo. The last inclusion holds because 



lim — 



x(t) 



G lim 

n— >oo 

C lim 

n— >oo 

We now have 



\j W o](x{t),F % (x))dt + \{ fe||x(t)-x||Bdf 
M l J j." M l J j.™ 

Fi^ + fcHGH 4r / tdt 



Fi(x). 



X n X 1 

lim = lim — 

n— >oo tn n-^-oc t r 



±{t) dt 
dt 



L n JO 

= y iim ^1 _L / i(t), 
^™t„ M «y u 

= ^ AiUi G ^ AiFi(x) 

by (|6.5p . Hence v G G(x) by (|2.1|) , Now let M := U^^-jA^, and since 

for all large n, we must also have v G 7xf(x). The proof is completed by verifying 



(.(».<;.) {co y W^flT^x) C G(x)f]Tj^(x) C coG»(x). 
Indeed, since -Fi(y) C TmAv) whenever ?/ G A4i, one must have 
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whenever x € Mi. Taking the union over i G i(x) and then the convex hull yields 
(|6.6|) . and finishes the proof. □ 

Remark 6.1. It may reasonably be surmised that the vectors Vi in the above proof 
belong to Fi(x) D Tj^. (x). However this is not the case in general, further demon- 
strating how complicated trajectories to stratified systems can be. See Example [3] 

Remark 6.2. The proof of Theorem 16.11 actually shows that 



C co G l> {x), 



(6.7) Klim 

where Klim denotes the Kuratowski limit of sets and By' (x) is the reachable set at 
time t from x (The definition of Klim is provided in the appendix) . Such a result for 
Lipschitz dynamics is relatively simple and can be used to characterize the reachable 
set semigroup in terms of its "infinitesimal generator" . See [18] . The observation 
(|6.7p gives further justification for calling G* the essential velocity multifunction. 

7. Examples 

We offer a pair of examples here to illustrate (1) why the proof of Lemma [5.51 
has to be so complicated, and (2) a curious phenomenon that arose in the proof of 
Theorem 16.11 when the structural condition needed to be invoked on the velocity 
sets. 

Example 2. We provide a simple technique with N = 2 for which a trajectory can 
be constructed to exhibit very complicated behavior while crossing a manifold. Let 
Mi and Mi be the upper and lower half planes respectively and M3 the cci-axis. 
Let the dynamics be given by 

Fifo) = F 2 M={( 1 ):-l<u<l 



X2 J \X2 j [ \U 

») - {f;'i=-'<«i 



For an interval [a,b], define ip a .b ■ [a, b] — » R 2 by 



1 if a < t < 22±& 
1 if 2±p < t < b 



*(*) = I [,„ \^ ) ds - 



and a trajectory x{-) by 

^ r 1 

Then x(-) is a trajectory on [a, b] that begins and ends on M3 with half of its 
time spent in Mi and the other half in jM 2 - See Figured! 

Now suppose {(a ra ,6 n )} is any collection of pairwise disjoint finite intervals in 
(0, +00), and let 



v(t) 




if t S (an,b n ) 

OO 

if t i (J (a n ,b n ). 
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Figure 3. The trajectory a;(-) 

The trajectory x(t) — L v(s) ds crosses the a;-axis at the midpoint of every interval 
(a n , b n ) and lies on the x-axis off of U^_ 1 (a„, b n ). This trajectory will exhibit Zeno 
behavior if b n — > 0, and will be very complicated indeed if, for example, the set 
A := (0, +oo)\ U^ =1 (a n ,b n ) is nowhere dense with meas((to,ti) flA) > for all 
< t < t\. 

Example 3. We modify the previous example by splitting all the manifolds by 
inserting the X2-axis. We need not label or introduce additional dynamics because 
we are only interested here on behavior when x\ > 0, and refer to A4i, M.2, M3 
as being the same as in Example [5] intersected with the right half space. For an 
interval (a, 6), now define 

f 1 if a < t < 

¥>«,&(*)=< -1 if^<i<^±3b 

1 if 2a±36 < t < a±4h 

V — — 5 

Let {c n } be any sequence strictly decreasing to and set a n — c n and b n = c n+ i. 
Let 



v(t) 



1 

i Pa n .b n {t) 



ate 



a n +4b„ 



0) rf**UK— 5— )• 

7 n— 1 v 7 

The arc defined by x(t) — J Q t v(s)ds is another Zeno-type arc, and has derivative 
equal to —1 while on the xi-axis. This occurs one-fifth of the time on every interval 
(0, c n ), and shows that the vector vi produced in (|6.5[) may not lie in 7^(0), where 
in this case M = Mi U M 2 U M 3 . 

8. Conclusion 

Our main result was a characterization of flow invariance for dynamics defined on 
a stratified system. With the underlying dynamics now discontinuous, the classical 
theory involving Hamiltonian inequalities required a modification. We imposed two 
conditions (proximal smoothness and wedgeness) on the subdomains that were not 
considered in the original formulation in Q] of a stratified system. We believe these 
conditions are natural and may become standard in future studies in optimal control 
where a switch to a lower dimensional manifold demands greater attention to detail. 
In the present context, these conditions were helpful in identifying what we called 
G", the essential velocity multifunction. Before fully investigating the essential 
velocity multifunction, we first gave a new general theorem for the sufficiency of 
strong invariance for a system with perhaps non-Lipschitz data but satisfying a 
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potentially weaker assumption that we called the Euler arc property. It is not clear 
which multifunctions beyond the Lipschitz ones satisfy this property. Another 
difficult feature of the analysis was to show h G $ was also capable of characterizing 
weak invariance. 

The general approach of utilizing the stratified structure of this paper is being 
applied to analyze other classical problems. In particular, a new approach to state 
constraint problems will appear in |20| and to reflected problems in 16]. The basic 
idea is to identify the "essential velocity" multifunction G* in these problems whose 
associated Hamiltonian achieves the following: 

(Objl)„ G' must be large enough so that an Hamilton- Jacobi inequality of type 

h G n < will characterize weak invariance, and 
(Obj2)^ G" cannot be too large so that an Hamilton- Jacobi inequality of type h G t > 

will characterize strong invariance. 
Finding the right balance between these competing objectives leads respectively to 
existence (with (Objl)) and uniqueness (with (Obj2)) results to Hamilton- Jacobi 
equations. 

Appendix A. 

This appendix delves into the details of the "relative wedge" assumption, culmi- 
nating in the proof of Lemma 13.11 A wedge assumption is that every normal cone 
at a point of the boundary is pointed, so our remarks will focus on "pointedness" 
rather than wedgeness per se. This is the case for the relative concept as well. 

A.l. Pointedness. A closed cone K C R w is said to be pointed if Kn(—K) = {0}. 
A result by Rockafellar [T3] says that a closed set C C M. N has a pointed (Clarke) 
normal cone at c E C if and only if C is epi-Lipschitz around c. The latter means 
that after a unitary change of coordinates, C locally has the form of an epigraph of 
a Lipschitz function. Technically, this means there exists a unitary map $ : M. N — > 
x K, a constant e > 0, and a Lipschitz function g : eBjy_i — > R with g(0) = 
so that 

(A.l) $(C-c)p|jeBjv-i x (-£,£)! = {epif/lpljeBw-i x (-e,e) 

(Bjv_i denotes the unit ball in R^ -1 ). The condition Afc(c) being pointed is also 
equivalent to 7c (c) having nonempty interior (see [13]). 

In addition to A/"c(c) being pointed, suppose that C is proximally smooth. Then 
the Lipschitz function g in (|A.lj) is lower C 2 ([HI 03] and [U Theorem 5.2]). This 
means there exists a representation 

(A.2) g{y) = max{g a (y) : a e A}, 

where A is a compact metric space and g a : eBjv-i — > R is such that g a {'), Vp l a (-), 
and V 2 (? a (-) are all continuous as functions over (y,a) G eM^-i x A. For all 
y G sBjv-i, it can be shown that (see QTl [15]) g(-) as in (IA.2I) has a directional 
derivative g'(y;w) in all directions w G I™ -1 , and moreover, satisfies Danskin's 
formula 

(A.3) g'(y;w) = max (V y g a (y),w), 

a£A(y) 

where A(y) := {a G A : g(y) = g a (y)} (see also [3]). 
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One advantage of having the representation (|A.2|) is that the boundary of C near 
x can be easily recognized as the points (y, g{y)j : ||y|| < e}. This fact will be 
used below in the proof Lemma 13.11 

The representation (|A.2[) provides a relatively simple means to calculate the 
normal and tangent cones as well as determine their interiors and boundaries. Recall 
that $ was unitary, which implies that normal and tangent cones are preserved 
under the transformation. Denote by cone K the convex cone generated by K. 
One can verify that 



(A.4) 



(A.5) 



A/He) 



Te(c) 



cone $ 1 

n 



{(V 5a (0),-l):ae A(0)} 



co |J N c {c') 

f>0 \\c'-c\\<v 



cone$ _1 {(w, 1) : (V g a (0),w) < 1 Vaei(O)} 
fl Te(c'). 



Klim 



\\c' —c\\ </' 

The proofs of the second representations (|A.4[) and (|A.5|) rely heavily on the reg- 
ularity assumptions of (y,a) h4 g a (y), Vg a (y). Here, K, — KlimK v refers to the 

Kuratowski limit of sets, which means two things: 



lim inf dist(a;, /C„) 

v — ^0 



Vie/C, 



and, secondly, if v n — > and x Vn £ K, Vrl are sequences with x Vn — > x, then x S /C. 

One can derive formulas from (|A.5|) for the interior and boundary of the tangent 
cone. We leave these routine derivations to the reader. 



int Tc(c) = 



cone 



{(w, r) : 3/i > so that 



(Vfl„(0),u>) < H|[r-/i(||V 5o (0)|| + l)] Vae A(0)} 



v e 



5 iV 



3/i > so that (C, v) < — || CM VC £ A/" c (c) 



$ _1 cone {(w,-l) : 3a G A(0) so that g'(0;w) = (V g a (0),w)} 
v S 7c(c) : 3C S JV c (x)\{0} so that (C,w) = 



(A.6) 

bdry 7c( c ) 
(A.7) 



A. 2. Relative concepts. In this subsection, we extend the pointed concept of a 
normal cone to lower dimensional manifolds. We mention that we are not intro- 
ducing this concept for arbitrary proximally smooth sets, but rather only to those 
that are closures of embedded manifolds. 

Suppose A4 is a d-dimensional manifold embedded in 1 N , and its closure M is 
proximally smooth. If d < N and x e M, then by considering a local chart near x, 
one can show there must exist a subspace of dimension at least N — d belonging to 
J\fj^(x) . We say that N-j^{x) is relatively pointed provided it contains no subspace of 
dimension larger than N—d. This assumption allows for a description of the normal 
and tangent cones associated with lower dimensional manifolds in a manner similar 
to what was described above for dimension N. After a change in coordinates, the 
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normal cone is of the form M d x ~R N ~ d and the tangent cone of form T d x {ON-d} 
where Af d , T d are convex cones lying in the subspace of H N consisting of the first 
ci-coordinates, and ON-d is the zero vector with TV — d coordinates. We have that 
Afj^(x) is relatively pointed provided Af d is pointed. This is equivalent to saying 
that the cone T d has nonempty interior, or again equivalently, that the relative 
interior (in the sense of convex analysis - see 112) ) of the cone T-j^{x) is of dimension 
d. The relative interior of a convex set C is denoted by r-int C, and its relative 
boundary r-bdry C is defined as C\r-int C. 

We return to the situation where a (proximally smooth) stratification {M\, . . . , 
M m} is given, and recall the dimension of Mi is di. Fix i, and suppose x G Mi- If 
x G Mi then r-int Tj^.(x) — Tyvi^a;) ~ R di and r-bdry Tj^.{x) = 0. An important 

property of v when x G A4;\A^i and v G r-bdry 1~m.( x ) was stated in Lemma 13. 11 
whose proof we can finally provide. 

Proof of Lemma \3.1[ We are given x G Mi and v G r-bdry Tj^. {x). We must show 
there exists another subdomain Mj C Mi with x G Mj and v G Tj^. (x). Note that 
the relative boundary r-bdry 7j^.(x) can be not empty only if di > 0, so without 
loss of generality, we can assume di — TV. By (|3.1j) . there exists a sequence t„ \ 



so that x+tri t v Xn -> where x n = proj^y (x + t n v) (the closest point is unique for 
large n by proximal smoothness). The rest of the proof is simple if x + t n v ^ Mi 
for infinitely many n. Indeed, in that G bdry Mi, and since there are 

only finite many subdomains in the stratification, there exists an index j so that 
x n G Mj for infinitely many n. It is clear then that x G Mj and v G Tr^\x). The 
other case is where x n = x+t n v G Mi for all large n. The proof here is considerably 
more difficult and we resort to the representation (|A.2j) that is available for Mi- 
Changing coordinates, we can assume without loss of generality that x = and 
that Mi = epi g (locally) where g is of the form (IA.2I) . For z G M. N , we write 
z = (z^ -1 , z N ) G R*^ 1 x M, and with this notation, are given x n — t n v satisfying 

(A.8) x%- 1 =t n v N - 1 and 

The assumption v G bdry (x) implies v N — g' ^O;^ -1 ) by (IA.7I) . From Dan- 
skin's formula (|A.3[) . there exists a G ^4(0) for which 

v N =g'(0;v N - 1 ) = (\7g a (0),v N - 1 ). 

We calculate using this that 

x - (V^CO),^" 1 ) = lim 

n— >cx 



V 



Ja(t n V 



N-l\ 



< lim 



x 



N 



N 



(A.9) < lim -2- = v 

where the inequality in (|A.9[) follows since we are assuming x n G Mi (and thus 
x n > 9 (xn^ 1 ))' an d equality just restates (|A.8p . Since (x% , gix^)) S bdry Mi 
for each n, there exists an index j so that Mj contains infinitely many of them. 
Therefore G Mj and v G 7^(0). Since M } C M t and Mj n A^i = 0, we must 
have c?j < di, and the proof is complete. □ 
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